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System for improving data throughput of a TCP/IP Network connection with slow return 




channel 





(57) A data transmission control arrangement for an 
asymmetric communication system having a fast down- 
stream link enabling communication of information 
packets from a service provider to one or more subscrib- 
er terminal connected through a common network ter- 
minal, and a slow upstream link including transmitting 
packets from a subscriber terminal through the network 
terminal to the service provider, the data transmission 
control arrangement including a classifier device for 
classifying information packets received by the network 
terminal for transmission over the upstream link, the in- 
formation including data packets and acknowledgement 
packets; a control device for establishing one or more 



upstream link connection queues in the network termi- 
nal in accordance with the classification of the informa- 
tion packet to be transmitted, the upstream connection 
queues including one or more data queues for transmit- 
ting data information and ACK queues for transmitting 
ACK packets in response to data packets communicat- 
ed over the downstream link, the control device enabling 
a later received ACK packet to replace one previously 
received ACK packets stored in a particular upstream 
link connection queue; and, a scheduler for servicing 
each of the upstream connection queues and transmit- 
ting packets from the upstream link connection queues 
to the service provider in accordance with transmission 
parameters of both upstream and downstream links. 
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Description 

RELATED APPLICATIONS 

This application claims the benefit of provisional U. 
S. Patent Application Serial No. 60/025,1 22 filed August 
30, 1996. 

FIELD OF THE INVENTION 

The invention relates generally to protocols for 
transporting data packets over a network connection 
and, more particularly, to an improved method for trans- 
porting data over the Internet Transport Protocol com- 
monly referred to as TCP/IP. 

BACKGROUND OF THE INVENTION 

It is expected that, within the foreseeable future, 
high speed Internet access services to residential sub- 
scribers will be provided using asymmetric access net- 
works, which include, for example, (a) networks employ- 
ing Asymmetric Digital Subscriber Line (ADSL) and var- 
iations thereof; (b) Hybrid Fiber Coax (HFC) networks; 
and, (c) networks where the downstream path (network 
to subscriber) is a cable link and the upstream path (sub- 
scriber to network or service provider) is a telephone 
link. One aspect of these systems is that they have an 
inherent bandwidth asymmetry which may be as low as 
1 0 when particular types of cable modems or ADSL ac- 
cess services are used in the associated network, or as 
high as 1 00 or more when the return path is a telephone 
link. Thus, an asymmetric network may be character- 
ized as having a fast downstream link from the network 
to the subscriber and a slower upstream link from the 
subscriber to the network. Also, it is likely that such a 
network will use the well-known Internet transport pro- 
tocol, TCP/IP, to transport data. 

Briefly, TCP/IP is a window-based flow control pro- 
tocol, in which a source of data transmits sequentially 
numbered data packets to a destination. The destina- 
tion, responsive to receipt of the data packets, returns 
a so-called cumulative acknowledgment (ACK) which 
identities by sequence number the next expected data 
packet. If the destination receives correctly all of the da- 
ta packets up to sequence number N, then the destina- 
tion indicates that the next data pack it expects to re- 
ceive is packet number N+1 . In TCP/IP, the source main- 
tains a dynamically varying window size. A window size 
of W packets means that the source may send data 
packets respectively having sequence numbers up to n 
+ W when the acknowledgment it receives from the des- 
tination indicates that the next expected packet is n + 1. 
If the round trip delay between the source and destina- 
tion is relatively large, then the widow size is typically a 
large value for efficient management of the associated 
bandwidth. This is done in TCP by increasing the size 
of the window until a transmitted data packet is lost, and 
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then decreasing the size of the window to a more effi- 
cient value. (It is noted that the amount that the window 
is decreased is different for different forms of TCP - il- 
lustratively TCP-Tahoe and TCP-Reno.) The loss of a 
5 packet in TCP/IP is detected using preferably a "fast re- 
transmit" scheme, one that is typically based on receiv- 
ing several acknowledgments (hereinafter "ACKS") 
each identifying the same next expected data packet (e. 
g., N + t ). Such ACKs imply that packet N + 1 had been 
io lost and needs to be retransmitted. A "fast retransmit" 
is typically triggered when a given packet (e.g., n + 1 ) is 
lost, but a number of successive packet were received 
correctly by the destination. Disadvantageous^, howev- 
er, if all of the packets after n + 1 are lost, or if n + 1 is 
15 the last packet sent by the source, then the "fast retrans- 
mit" packet scheme may fail to detect the loss. To deal 
with that possibility, then such detection relies on the ex- 
piration of an "coarse'' timer having a "granularity" of, for 
example, 500 milliseconds, is used to detect the loss of 
20 such a packet. That is, when a packet is transmitted the 
timer is started to wait for the receipt of a corresponding 
ACK. If the ACK is not received prior to the expiration of 
the timer, then it is assumed that the packet was lost, 
which means that the transmission link will remain idle 
25 for that period of time, since new packets are typically 
not transmitted prior to the expiration of the timer. 

It is apparent from the foregoing that TCP connec- 
tions are established in both directions on a network. In 
particular, as shown in Fig. 1 illustrating a conventional 
30 single TCP connection, a forward connection 20 uses 
the fast downstream link 25 to carry packets from a 
sender 15 (in the network) to a data terminal 16 (sub- 
scriber side). The data terminal 16, on the other hand, 
uses the slow upstream link 26 to send ACKs to the net- 
35 work sender 1 5. Conversely, a reverse connection uses 
the upstream link 26 for sending data packets from the 
data terminal 1 6 to the network sender 1 5 and the down- 
stream link 25 for sending acknowledgments from the 
network sender to the data terminal. A TCP destination 
40 returns explicitly or implicitly an ACK for every data 
packet that it receives successfully. Most ACKs have to 
be explicit because TCP uses ACK for congestion con- 
trol as well. Hence, a large volume of data packets re- 
ceived over the downstream link 25 will cause a large 
^5 volume of ACKs to be carried over the upstream link 26. 
Clearly, then, this may cause congestion to occur on the 
upstream link, and specifically, at the single upstream 
buffer, 30, the which may lead to a loss of data packets 
for the reverse connections. As mentioned above, such 
50 losses may cause the reverse connections to decrease 
the size of their respective windows - which would 
cause an appreciable decrease in throughput to occur 
unless the resources (e.g. , buffers and bandwidth) of the 
upstream link are specifically allocated to those connec- 
55 tions in a controlled way. Also, a loss of ACKs may cause 
an increase in burstiness at the sender. For example, 
assume that the size of the window is W and that the 
source is waiting for an ACK corresponding to packet n 
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- meaning that, if the window is fully used, packets up 
to n + W have been sent. Also assume that the destina- 
tion received successfully all packets, but the ACKs as- 
sociated with packets n through n + 4 were lost and that 
the ACK for packet n + 5 was received successfully by 
the source. When the source receives the latter ACK, 
then the source "knows" that the next expected data 
packet is the n + 6 packet, and, therefore, should be 
allowed to transmit packets up to n + 5 + W. Since the 
source only sent packets up to n + W, it is then allowed 
to transmit the next five packets. If the buffer is smaller 
than 5. then this would cause packets to be lost, which 
may cause a decrease in the size of the corresponding 
window Also a loss of all outstanding ACK packets 
would lead inevitably to a time-out, decrease in the size 
ot the window and decrease in the efficiency of the sys- 
tem Moreover this is likely to happen whenever the size 
of W is snrviii icg. W = 1). 

SUMMARY OF THE INVENTION 

Thus in view of the foregoing, we have recognized 
that bandwidth needs to be reserved on the upstream 
link for the proper operation of the reverse connection, 
such bandwidth n\oo needs to be reserved for the trans- 
port of ACKs that are sent as a result of receiving data 
packets via the downstream link. If sufficient bandwidth 
is not allocated to handle the transmission of ACKS, 
then the asymmetry of the bandwidth between the for- 
ward and reverse paths of a forward connection may 
cause excessive burstiness to occur on the forward 
path, which could lead to a loss of data packets and a 
decrease in throughput due to a decrease in the size of 
the window. Thus, the reservation of bandwidth on the 
upstream link must be managed well to obtain good per- 
formance for both the forward and reverse connections. 
This is done, in accordance with the principles of the 
invention by (a) preserving at a point of congestion along 
the reverse link, e.g., a buffer, the last ACK in place of 
a previously received ACK. (b) allocating the bandwidth 
of the upstream link including associated memory (buff- 
er) in a well managed way, and (c) using, for e.g., a fair- 
queuing or a weighted round-robin scheme to allocate 
the bandwidth of the upstream link such that the weight- 
ing is based on parameters associated with the down- 
stream link. This is achieved while maintaining the band- 
width ratio of forward to reverse path of each connection 
below a predetermined boundary. 

Specifically, when congestion occurs, we preserve 
the last (most recent) ACK transmitted by the destina- 
tion and do so by illustratively dropping an ACK that is 
stored at the "front/top" of a congested upstream buffer 
to make room for the storage of the most recent ACK. 
Also, the loss of data packets on reverse connections is 
prevented by reserving bandwidth on the upstream link 
for the transport of the data packets. In accord with an 
aspect of the invention, such reservation of bandwidth 
is achieved by using logically separate data buffers for 



the data packets and ACKS in the return (upstream) 
path. Further, the servicing of the upstream link is based 
on a weighted round robin service in conjunction with a 
queue per connection, in which, in accord with an aspect 

5 of the invention, such weights are chosen according to 
particular parameters associated with the downstream 
link. In particular, if, for example, the downstream link 
has a transmission rate of C d packets/second and the 
size of the buffer on the upstream link is B d packets, 

io then the available bandwidth for ACKs on the upstream 
link for an associated forward connection should be at 
least C d /B d ACKs per second. All of the remaining band- 
width on the upstream link may then be allocated to data 
packets from reverse the connections carried over of the 

75 upstream link. The separate buffers and weighted serv- 
ice sheme is essential to ensure that that reverse con- 
nections get their fair share of bandwidth. 

The various features of novelty which characterize 
the invention are pointed out with particularity in the 

20 claims annexed to and forming a part of the disclosure. 
For a better understanding of the invention, its operating 
advantages, and specific objects attained by its use, ref- 
erence should be had to the drawing and descriptive 
matter in which there are illustrated and described pre- 

25 ferred embodiments of the invention. 

BRIEF DESCRIPTION OF DRAWINGS 

Figure 1 is a general diagram illustrating a conven- 
30 tional single TCP/Internet connection; 

Figure 2 is a context diagram incorporating a com- 
plex queue buffer in the upstream link of a single 
TCP connection; 

Figure 3 is a block diagram illustrating the compo- 
35 nents of the inventive complex queue; Figure 4 is 
an illustrative example of an internet connection uti- 
lizing the data flow control arrangement of the in- 
vention. 

40 DETAILED DESCRIPTION OF THE INVENTION 

Fig. 2 illustrates a data flow-control arrangement for 
a TCP network connection, and particularly, is a context 
diagram showing the inventive TCP connection servic- 
es jng a multiplicity of user PCs 50a,50b,..,50n. As shown 
in Fig. 2, each customer PC 50a,. .50n etc. is connected 
to a local area network 55 including a connection or sub- 
scriber network terminal 100. The subscriber network 
terminal 100 receives data packets from a forward 
so (downstream) link 90 connection from a service provid- 
er, e.g., WAN/Internet 80, serviced by a server 82. Spe- 
cifically, these data packets are communicated from a 
service provider network terminal 85 over forward link 
90 for receipt by the subscriber local area network 55 
55 which distributes or demultiplexes the packets to the ap- 
propriate customer termination (PC). The subscriber 
network terminal 100 includes a forward queue 97 that 
temporarily stores and passes the received data pack- 
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ets to the subscriber local area network at a particular 
rate. The customer PC's, in turn, provide acknowledg- 
ment (ACK) packets for receipt by the service provider 
network 85 via a reverse (upstream) link 95. The PC's 
may even provide data packets to the subscriber local 
area network 55 which, in tun% multiplexes the data for 
upstream transmission to the network terminal 100. As 
discussed above, the prior art TCP connection architec- 
ture is characterized as being asymmetric having a fast- 
er downstream link 90 from the service provider network 
85 to the subscriber network 55, and a slower upstream 
link 95 from the subscriber network 55 to the service pro- 
vider network 85, normally causing bottleneck, random 
loss of packets, and intolerable delays and throughputs 
in conventional TCP/IP connection architectures. To en- 
sure maximum throughput of packets, the network ter- 
minal 100 is provided with an inventive reverse link 
"complex" queue 150 capable of establishing individual 
per connection queues for optimally forwarding both da- 
ta and ACK packets to the service provider network ter- 
minal 85 over the reverse link 95. It is understood that 
the prevalent TCP-Tahoe and TCP-Reno protocols for 
Internet communication govern the upstream and down- 
stream bit rates over respective forward and reverse 
links. 

As shown in Fig. 3, the complex queue 1 50 includes 
a memory storage area facilitating the establishment of 
a plurality of per conection queues 151 a,..., 151 n. To 
maximize data throughput, as shown in Fig 3, the com- 
plex queue 150 is structured as a front-end processor 
101 that performs a queue management function, de- 
picted as queue manager 160; a packet classification 
function, depicted as Classifier 200; and, a packet trans- 
mission scheduling function, depicted as Scheduler 
300. The above-mentioned functions performed by the 
front-end processor cooperatively enables a plurality of 
buffer queues to be established on an as needed basis 
for storing and transmitting upstream bound packets of 
information on to the reverse link 95 in accordance with 
memory and queue management and scheduling poli- 
cies. 

For instance, under the control of the front-end 
processor 101, the Classifier 200 looks at every incom- 
ing packet from the subscriber network and classifies its 
type, e.g., data, ACK, etc. It also keeps track of the ex- 
isting connections and their type, (greedy, sporadic, da- 
ta, ACK), assigns a respective queue 151a ; ,.,151n to 
each connection, and places the packet in the correct 
queue. Specifically, each of the source PC's 50a,b,c 
have a corresponding network address and port asso- 
ciated with it, and when sending data or ACKs to a des- 
tination address and port, a dynamic queue connection 
may be set up in memory to store the information for 
eventual transfer to the destination address/port. The 
classifier 200 generates and maintains a table (not 
shown) of queue connections established for particular 
source address/ports and correponding destination ad- 
dress/ports, thus keeping track of the upstream commu- 



nication of data or ACKs between particular source and 
destinations. Depending upon the cost and/or memory 
constraints of the system, one queue 151 may be dy- 
namically established for receipt of, e.g., data packets 
s and another queue may be established for receipt of, e. 
g., ACK packets regardless of the number of transmit- 
ting sources. Thus, it is preferred however, that a queue 
be established for each distinct TCP connection. In 
practice, it is expected that the number of queues will 
io be limited and queue occupancy schemes will be en- 
forced by the memory and queue manager to enable 
dynamic replacement when all queues are occupied. 

As shown in Fig. 3, the memory and queue manager 
160 stores packets in memory queues and enforces 

is queue occupancy policies. Particularly, when all of the 
queues are occupied and a new source/destination con- 
nection is established, the queue manager may dynam- 
ically enable a queue to become available for upstream 
transmission of new packets between the new source/ 

20 destination connection. Within the constraints of the 
TCP/IP protocol implemented, e.g., TCP-Tahoe, one 
scheme is to implement a time-out function whereby the 
queue manager determines inactivity of a queue estab- 
lished for another source/destination connection, i.e., 

25 the occupied queue neither receives a packet nor trans- 
mits any packets within a certain period of time, e.g., 
five minutes. The table of the per queue connections in 
the Classifier 200 will be updated accordingly. 

Additionally, as explained herein, the queue man- 

30 ager 160 implements a first received packet rule, which 
enables the queue manager to always keep the last re- 
ceived packet in a queue under any circumstances, and 
drop any older packet from the queue. 

A crucial aspect of the physical link layer of this sys- 

35 tern, is to determine when the reverse link layer is free, 
e.g., after a packet has been transmitted. According to 
the particular system requirements, e.g., ADSL, HFC, 
etc., there exists well-known hardware implementations 
to ascertain the occupancy (used bandwidth) and the 

40 status other parameters of the forward and reverse 
links. Once a determination is made that the reverse link 
is free to transmit, the Scheduler 300 services the 
queues by selecting a packet from a particular queue 
151a,..,151n to be transmitted according to transmis- 

45 sjon management policies. Such transmission manage- 
ment policies include, e.g., fair-weighted queuing, 
where each queue is given equal service time. Thus, in 
the case of transmitting ACK packets in accordance with 
the weighted scheme, the processor will determine crit- 

50 jcal parameter information about the forward (down- 
stream) link 90 such as downstream transmission rate, 
c down (bits/second) and size of the downstream bottle- 
neck (forward link) buffer B down , and, additionally, infor- 
mation about the upstream link such as upstream trans- 

55 mission rate, C up (bits/second) and the length of, e.g., 
an ACK packet, L ACK , so that the scheduler may calcu- 
late a weight, W ACK , for the particular ACK packet and 
transmit the ACK packet according to its weight so as 
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to maximize transmission bandwidth. As will be de- 
scribed, the parameter information implicitly accounts 
for the round-trip delay times, forward buffer sizes and 
the normalized asymmetry in the network connection. It 
should be understood that selection of data packets for 
transmission over the reverse (upstream) link may be 
likewise determined. 

To further aid in the understanding of the invention, 
reference is made to Fig. 4, which illustrates a general 
example of an Internet connection 50 established be- 
tween a processor 40, and a web site 10 for the purpose 
of downloading information from web site 10 to proces- 
sor 40 via data network 20. The Internet connection in- 
cludes a control processor 30 and downstream link 35, 
which may be, for example, a conventional cable link, 
that connects to a plurality of subscribers. The down- 
stream link 35 connects to a plurality of subscribers, in- 
cluding processor 40, via respective interface devices 
(not shown), e.g., cable modems. If processor 40 hap- 
pens to be, for example, a personal computer, then it is 
likely that the connection was initiated in a conventional 
manner at the request of a user (not shown). This is typ- 
ically done by using the well-known TCP protocol and 
transmitting the message over an upstream link, e.g., a 
conventional telephone connection, to controller 30. 
Controller 30 then forwards the message via data net- 
work 20 to the Internet web site identified in the mes- 
sage, e.g., web site 10. Web site 10, in turn, transmits 
the requested information in the form of data packets 
via the aforementioned downstream link to processor 
40. Front end processor 41 receives the downstream 
packets and forwards them to the appropriate transac- 
tion, e.g., transaction 42. The transaction, in turn, gen- 
erates a conventional ACK packet in the TCP format and 
stores the packet in ACK queue 43 for transmission via 
the upstream link to web site 10. 

As mentioned above, it is likely that under particular 
conditions the ACK queue (buffer) 43 may become con- 
gested (full). In that case, then, a new ACK is usually 
discarded since it cannot be loaded into the queue. 
Since the new ACK contains more information that an 
ACK already stored in the queue, then, in accordance 
with the invention, the new ACK (i.e., the last ACK to be 
generated) is preserved rather than discarded. Thus, an 
ACK that is already loaded in ACK queue 43 is discard- 
ed to make room in the queue for the latest ACK. In an 
illustrative embodiment of the invention, the oldest ACK 
in the queue is discarded. 

The acknowledgement packets serve another pur- 
pose in TCP, i.e., the data packets are released at a con- 
trolled rate based on the arrival of acknowledgements 
to the data source. Excessive acknowledgement packet 
loss, even while preserving error recovery information 
as described herein, can cause disruption of this flow 
control mechanism. If N acknowledgements are lost, 
then the arrival of the (N+1 ) lh acknowledgement causes 
the source to release (N+1) packets simulteneously. If 
the data buffer is not large enough to absorb this burst, 



then data packets are lost, causing TCP to drop its win- 
dow, and hence resulting in low throughput. Hence, the 
management of the acknowledgement buffer must be 
such as to let the most number of acknowledgements 

s through, while always preserving the most recent ac- 
knowledgement. This leads to the drop-from-front buffer 
discipline for the return path which preserves the most 
recent error recovery information and enables the larg- 
est amount of flow control information. 

10 it is seen from the FIG. 4 that processor 40 also in- 
cludes packet queue 44, which may be associated with 
a particular "reverse connection" transaction process 
that is generating conventional data packets for trans- 
mission via upstream link 36. As mentioned above, un- 

15 der certain conditions, the throughput of the reverse 
connection may be close to zero unless the resources 
of the upstream link are allocated in a controlled way. 
As also mentioned above, such allocation is done, in ac- 
cord with an aspect of the invention, by dedicating 

20 queues to respective services, connections, ACKS, da- 
ta packets, etc. , and servicing the queues in accordance 
with a weighted scheduling scheme. Specifically, in ac- 
cordance with the invention, it is assumed that down- 
stream link 35 (FIG. 1 ) has a rate of C down bits/second 

25 and that slower upstream link 36 has a rate of C up (bits/ 
second). Additionally, it is assumed that TCP connec- 
tions are supported in either link and that the length of 
a data packet is L DATA and the length of an ACK is L ACK . 
For a forward connection, the maximum bandwidth 

30 available for a data packets is u^ L down packets per 
second, and the^naximum bandwidth Callable for ACK 
packets is j^ r = - z — ^2- . The "normalized asymmetry" be- 
tween the forwartfcfnd reverse paths is then defined as 
k = u.f /(i r , which is assumed to be a value > 1 . The size 

35 of a buffer that is available for buffering data packets 
that are to transported over downstream link 35 ^ as- 
sumed to be B down bits, which translates into Bp L down 
packets. The percentage of the total time that ma^Se 
allocated to the servicing of ACK queue 43 is: 



40 



W 



ACK 



up 



(1) 



45 To achieve near optimum service (throughput) of 
those queues in accordance with the invention, the fol- 
lowing relation of equation (2) specifies the weights that 
should be associated with ACK queue (buffer) 43 and, 
the following relation of equation (3) specifies the 

so weights that should be associated with data packet 
queue (buffer) 44: 



55 



C down L ACK 

B, C 

down up 



(2) 
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W DATA = 1 



w 



ACK 



(3) 



It should be understood that it is not possible to fully 
utilize the downstream link if the value of W ACK in equa- 
tion (2) is larger than one. Furthermore, it should be re- 
alized that more than one source could be supplying da- 
ta packets to the upstream link. In that case, then, each 
such source should be associated with its own packet/ 
data queue to achieve the most efficient servicing of the 
packets and. thus, the throughput of the upstream link. 

It is to be understood that the above general de- 
scription is |ust one illustrative example of a number of 
different ways which implement weighted scheduling 
that satisfies the conditions that for each connection the 
ratio of available packet service rate and available ACK 
service rate is smaller than the available buffer size on 
the forwarc path That is, for each connection k = uY(i r 
which is also equivalent to the average size of a burst 
of packets has to be smaller than B f , or else packets 
will be lost unnecessarily. If, due to imperfection of the 
scheduler (head of line blocking) "k" varies locally with 
lime : the worst case has to be considered. Thus, a 
schedulei buai ab a fluid model scheduler, is designed 
to minimize local deviation from the allocated rates. 

The foregoing is merely illustrative of the principles 
of the invention Those skilled in the art will be able to 
devise numerous arrangements, which, although not 
explicitly shown or described herein, nevertheless em- 
body those principles that are within the spirit and scope 
of the invention 



Claims 

1 . A data terminal implemented in a TCP network com- 
prising 

a processor for receiving data packets from a 
source over a downstream link and storing the 
downstream data packets in a downstream 
queue: 

an upstream acknowledgment queue for stor- 
ing acknowledgment packets generated re- 
sponsive to receiving respective ones of said 
downstream packets, said processor being re- 
sponsive to the generating of a new acknowl- 
edgment packet coincident with said upstream 
queue being full and for storing the newly gen- 
erated acknowledgment packet in said up- 
stream acknowledgment queue in place of the 
oldest acknowledgment packet already stored 
in said acknowledgment queue; 
an upstream data queue for storing data pack- 
ets that are to be transmitted over an upstream 
link, wherein said upstream acknowledgment 
queue and said data queue have associated re- 
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spective weight values determined as a func- 
tion of transmission parameters associated 
with said downstream link, said weight values 
for determining unloading of acknowledgement 
packets and data packets from said upstream 
acknowledgment queue and upstream data 
queue, respectively, for transmission over said 
upstream link. 

The data terminal of claim 1 wherein said transmis- 
sion parameters associated with said downstream 
link include downstream transmission rate, C down 
(bits/second) and size of the downstream data buff- 

er Bdown- 

A data transmission control arrangement for an 
asymmetric communication system having a down- 
stream link enabling communication of information 
packets from a service provider to one or more sub- 
scriber terminals connected through a common net- 
work terminal, and an upstream link including trans- 
mitting packets from a said subscriber terminal 
through said network terminal to said service pro- 
vider, said data flow control arrangement including: 

for said network terminal, a classifier means for 
classifying information packets received by 
said network terminal for transmission over 
said upstream link, said information including 
data packets and acknowledgement packets; 
control means for establishing one or more up- 
stream link connection queues in said network 
terminal in accordance with the classification of 
the information packet to be transmitted, said 
upstream connection queues including one or 
more data queues for transmitting data infor- 
mation and ACK queues for transmitting ACK 
packets in response to data packets communi- 
cated over said downstream link, said control 
means enabling a later received ACK packet to 
replace the oldest previously received ACK 
packets stored in a particular upstream link 
connection queue; and : 

scheduling means for servicing each of the up- 
stream connection queues and transmitting 
said packets from said upstream link connec- 
tion queues to said service provider in accord- 
ance with transmission parameters of both up- 
stream and downstream links. 

A data transmission control arrangement as 
claimed in Claim 3, wherein said network terminal 
includes memory storage means from which said 
upstream connection queues are established, said 
control means further allocating said memory stor- 
age to establish a separate upstream link connec- 
tion queue for a respective connect bn between a 
subscriber terminal and said service provider. 
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5. A data transmission control arrangement as 
claimed in Claim 3 t wherein said classifier means 
includes means for generating a table of estab- 
lished upstream link connection queues and their 
respective associated service provider and sub- 5 
scriber terminal connections, said control means re- 
sponsive to said classifier means for inputting re- 
ceived packets to an upstream connection queue 
according to associated service provider and sub- 
scriber terminal connection status. 10 

6. A data transmission control arrangement as 
claimed in Claim 3 : wherein said network terminal 
includes a downstream buffer for temporarily stor- 
ing packets communicated over said downstream 
link between said service provider to said subscrib- 
er terminal. 

7. A data transmission control arrangement as 
claimed in Claim 3, wherein said scheduler means 20 
services said upstream link connection queues ac- 
cording to a weighted scheme whereby each said 
upstream link connection queues are assigned pri- 
ority weights according to their size and occupancy, 
and transmitting said packets over said upstream 2s 
link in accordance with associated weight values. 

8. A data transmission control arrangement as 
claimed in Claim 3, wherein said scheduler means 
services said upstream link connection queues ac- 30 
cording toafair queuing scheme whereby each said 
upstream link connection queues is assigned an 
equal weight. 

9. A data transmission control arrangement as 35 
claimed in Claim 3 : wherein said transmission pa- 
rameters associated with said downstream link in- 
clude downstream transmission rate, C down (bits/ 
second) and size of said downstream buffer B^^. 

40 

10. A data transmission control arrangement as 
claimed in Claim 3 : wherein said transmission pa- 
rameters associated with said upstream link include 
upstream packet transmission rate, C up (bits/sec- 
ond) and the length of an ACK packetk, L ACK . 45 

11. A data transmission control arrangement as 
claimed in Claim 3 : wherein said network terminal 
includes a TCP/IP connection. 

so 
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